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ABSTRACT 

Based on a compilation of concepts and materials from 
various sources, this manual outlines a systems approach to the 
evaluation of local vocational education programs. Local evaluation 
is viewed as a team effort by those responsible for improvement in 
the system and is to be carried out as a continuous process. Major 
sections of the manual are: (1) The Local Evaluation Point of View, 

(2) Preparation for the Evaluation of Local Programs, (3) Major 
Activities and the Systematic Approach, (4) Organizing and Using 
Major Resources for Evaluation, (5) Product Evaluation - Student 
Follow-up and Employee Appraisal, and (6) Planned Action - 
Evaluation, Included in the appendixes are sample data collection 
instruments and cover letter. (JS) 
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FOREWORD 



The concepts and materials incorporated in this manual, while 
compiled and edited by one person, were derived from various 
sourc,_s. Research and development in Vocational Education 
Evaluation by the Multi-State Project, headed by Dr. Harold M. 
Byram and subsequent projects directed by Dr. Robert Norton and 
Dr. Floyd McKinney and others have contributed to this manual. 
Their assistance to the Tennessee Local Evaluation Project in 
total IS acknowledged and recognized. 

Cooperation of State Division of Vocational-Technical Educa- 
tion personnel, the administration, faculty and Boards of Educa- 
tion of the Memphis Area School, Polk and Robertson County 
schools has helped in the design ana "development of this project. 
Special thanks go to Mr. William Harrison and his State Staff, 
Richard Casti Ion, Roy Crabtree, Gus Eichholtz,T. J. Hendrickson, 
Elmo Johnson and George Whedbee and their vocational faculty 
and guidance folks. For these hundreds of man hours of contri- 
buted consultation, we are indebted. 

With a LOCAL focus, this manual attempts to present a sys- 
tems approach to evaluate the process and the product of voca- 
tional education. The approach holds as primacy that evaluation 
is a means to form, shape and improve. Recognizing the impor- 
tance of both objective expertise and involvement of those 
lesponsible for improvement change, the proposal is to team 
evaluate each program with common instruments. The domains 
of evaluation presently considered are: Public Relations, Facili- 
ties, Learning Activities, Student Follow-Up and Employee Ap- 
praisal. 
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THE LOCAL EVALUATION POINT OF VIEW 
Why Evaluate Vocational Education Programs? 

1. The Vocational Education Amendments of 1968 require 
evaluation. 

2. Tennessee State Plan requires a state advisory council 
based upon Public Law 90-576. 

3. The advisory council annual report (1970) recommends: 

Some procedures should be established whereby programs 
in vocational technical education may be evaluated on a 
basis of quality as well as quantity. 

There should be asserted effort to dcv^eiop an organized 
plan for collection and dissemination of valid and reli- 
able data pertinent to the program planning and evalua- 
tion effort. 

The council recommends the development of a plan for 
comprehensive evaluation of each technical education 
program in the state. This evaluation should consist of 
process as well as the product of instructional effort. 

4. Tennessee is fast becoming an industrial state. Programs 
in vocational-technical education have significant and 
direct effect on the speed, development and expansion 
of the economy. 

5. Vocational-technical education should shape the work 
and the lives of youth and adults. 
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Accreditation and state evaluation programs commonly place 
considerate interest on the ways and means that represent the 
educational process. The approach has been to establish 
standards which need to be met and to determine how nearly a 
program measures up to this standard or how a certain program 
compares with other programs in another locale within the state 
or region. Those people involved or affected by such evaluation 
usually have only a token interest in this approach. The rela- 
tionships between accreditation and the local evaluation program 
is one of mutual support. Both are considered essential to the 
total educational program. 

Self-Evaluation and Outside Evaluation 



Self-evaluation is that process commonly made by the school 
staff and the administration through joint efforts. There is some 
advantage to this approach as the personnel involved must sub- 
sequently implement the recommendations for change and bring 
about those changes. The difficulty which sometimes occurs, 
however, is that people involved in the program evaluation may 
be so close to the situation that they fail to sense some of the 
elements which need to be examined. Some school people may 
feel they lack the competence first to develop the evaluation 
instruments, and then to analyze and interpret the data. 

To compensate for some of these limitations some evaluation 
programs have been carried out employing outside consultants 
who are experienced in the area of evaluation. The experts may 
make the evaluation or assist the local personnel to make it. 
The latter has the benefit of obtaining outside competencies yet 
retaining the local involvement of staff people who must imple- 
ment the indicated necessary changes. 

Involvement in Evaluation 

One of the principles of evaluation which receives increasing 
acceptance is that those who are to be affected by and who will 
be responsible for implementing changes which are a result of 
the evaluation, should be involved in the process. This is to 
say that those who are to change the program outcomes should 
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be (hose who have helped establish the program evaluation. It i 

^nri/n^r ' «'’o liave responsibility for designio 

rhf ^'’‘^^''™3l-technical programs, it is the faculb 

hen who should be involved in the evaluation project. It is th( 
intent of this project to provide some means of incentive K 
encourage faculty membersto be involved in the total evaluation. 

Point of View of This Project 

tinn'^u vocational-technical educa- 

tion s looked upon as a team effort. The team should be made 

up of professional educators and selected advisory committee 
members. The team should be assisted by the Research Coor- 
dinating Unit (RCU). The RCU should provide tecS adv“e 

crsiln«°" 'eam. data pro- 

cessing, analysis, and a final report. The local evaluation focus 

IS on the human resul.s of the program in terms of meeting the 

eeds of the people and of providing trained workers for the 
business and industry community. 

Particular attention is directed to the concept of the contin- 

- not \::zz 

arnvp Z or ending. It is assumed th^ an 

active advisory committee will be organized for plannirr on- 

hoing participation. The advisory committee may assisr and 
sustain the local instructor in his program by providing business 

succe^ss^^ The students job placement and job 

uccess. The learning activities evaluation should be made for 

ntl'SS.'’' --'onal-lechnical program inTrdtr"' 

Living in the age of technology, todays Americans have come 
0 recognize a need for change. It is generally accepted that 
knowledge is doubling every five to seven yearsi The resulting 
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or Ife's employment has made people more conscious of he 
need for ad,ustment based upon the recognition of ^ew knolvl! 
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The State Plan calls for, "change to meet the long.-range and 
immediate state occupational needs." The plan calls for "redi- 
rection of some present programs and implementation of new 
programs." The evaluation of the quality of the present pro- 
grams is of utmost importance to implement change for improve- 
ment as acknowledged by the advisory council. It is generally 
recognized that it is the responsibility of the local faculty to 
implement the necessary changes. 

The point of view of this manual is that evaluation should be 
done by those who are re ponsible for improvement of the pro- 
g.ams. Local faculty should be involved in the selection of the 
evaluation materials and the design of the local evaluation 
program. Advisory consultants should be utilized for their 
expertise and should be selected by the local faculty to best 
meet the evaluation program needs of each vocational-technical 
career area. 
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CHAPTER li 



PREPARATION FOR THE EVALUATION OF LOCAL PROGRAMS 



Deciding What to Include in the Local Evaluation 

The ultimate objective of evaluation is to structure the deci- 
sions in a change process where and when change is necessary. 
In the process of structuring decisions it is important to involve 
the appropriate personnel to accomplish the change, (See Figure 
# 1 ). 

The basic structum should include dwareness of what the 
program is to achieve, the alternate means to achieve these out- 
comes, and the relative design of alternatives of structuring and 
implementing the decisions. Involved on the one hand is an in- 
depth knowledge of the local program being evaluated and on the 
other hand the broad prospective of the high school and post- 
secondary vocational-technical offerings and the long-range State 
Plan. It appears then that analysis of the evaluative data, and 
the planning and structuring of decisions should logically be 
accomplished by representative personnel of both the state and 
the local [irogram. It is acknowledged that the State Plan will 
require certain key data recorded by each individual vocational 
program. The main emphasis on the evaluation program, however, 
IS loca l involvement -in the design of the local evaluation, of the 
local advisory committee to represent a variety of concerns of 
industry, of local professionals to make the appraisal and finally 
to implement the indicated program changes for improvement. 

The scope of an evaluation of the vocational programs will 
depend upon what the hical administrators and teachers want to 
include above and beyond the requirements of the State Plan. It is 
suggested that all of the curriculums that involve students who 
are preparing themselves to enter employment be considered as 
vocational-technical education. Evaluation should not be limited 
to only those programs or courses eligible for reimbursing with 
Federal funds. The evaluation of any industrial arts and/or home 
economics courses principally designed for general education 
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exploratory programs would be included in the evaluation only 
upon the recommendation of the local faculty. 

If tliC evaluation program is to serve as a' means of making 
decisions for the development of new programs, the evaluation 
must include: local opportunities and/or occupational interests 
on the part of high school students, parents and industrial and 
business personnel. In this day of transportation flexibility and 
mobile living conditions the "Mocai community" in some instances 
may be considered a region of the entire state in particular 
career needs. It is suggested that a vocational program that 
overshoots the geographical boundaries of the local community is 
more appropriate today than to limit the career preparation of 
youth. 

It is highly important that the local evaluation include post 
high school vocational education needs for the community. With 
the advance of technology and especially with numerous state 
vocational-technical schools strategically located, these post- 
secondary opportunities should be considered during the total 
evaluation process. To satisfy business and industry employment 
conditions, youth entering the post-secondary institutions might 
be better prepared through a broad scope pre-vocational or 
career exploration program in high school. Further broadening of 
the evu.uiuiori process is indicated by the changing occupational 
complex, the demand for adult vocational and technical education, 
including the need for retraining of adults. 

The program of vocational guidance within the local schools 
should be considered within the scope of the evaluation program. 
Placement of students, both graduates and non-graduates, in em- 
ployment and follow-up of these students through employer- 
employee evaluations should be considered part of the total 
guidance program within the institution. Evaluation on a con- 
tinuing basis of these former students by their respective employ- 
ers furnish one of the critical data sources for evaluation of the 
product of educational services. 
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Broadening the Approach of Evaluation 



Teachers generally have accepted responsibility for evaluation 
of their instruction with a focus on evaluation of student achieve- 
ment. Some teachers have sought to validate the content of 
vocational courses taught by asking for reaction of students and 
parents to the content of these courses. Another more recent 
development is the systematic approach of identifying specific 
objectives, behavioral goals and outcomes, and determining the 

kinds of evidence which indicates the degree of success or 
achievement. 



Along with business and industry the process of assembly line 
production has entered education through the medium of class 
schedule, the moving from mom to room forindiviaua! andseparate 
instruction in the various courses. Much like the person in 
business and industry, the teacher now gets a somewhat fragment- 
ed viewpoint of vocational education as a whole. Rather than be 
concerned about the quality of product, the whole student prepared 
or the world of work, teachers have been more vitally concerned 
with a specific course or courses taught. Before embarking on a 
local evaluation of the vocational-technical programs it should be 
ee ry understood with the local administrators, teachers and 
dvisory committee that the major emphasis should be the total 

woHd o7work "" to turn out youth and adults for the 



Program effectiveness should be judged in terms of the extent 

Lnl pm ^"'P^ ^he student to 

'' ' 

Administrative Authority In Program Evaluation 

Through the pilot project, the initiation of a local project and 
he application for a mini-grant may be made by the chief admini- 
stra or of a system. School boards should be made aware of the 

aL'I^ at n in the project. The RCU 
an State Division of Vocational Technical Education personnel 
will decide which schools, of those making applications^, will be 



funded by a mini-grant. A RCU representative will visit with 
each school administrator to initiate the local evaluation project. 
The project should be initiated on’y when the administration and 
and the school staff want and feel the need for evaluation. 

Developing a Plan for Directing the Evaluation 

Assuming that local evaluation is desired by the administration 
and faculty, primary emphasis should be given to planning. A 
plan for conducting the local evaluation should be designed and 
made available for all those involved, including state and local 
personnel and the content, activities and time schedules agreed 
upon. The plan should contain the following items of information: 

1. Objectives of the project 

2. Scope and duration of the study 

3. Organization and function of the faculty committee 

4. Organization and preferences of the citizens advisory 
committee 

5. Plan the proposed activities to be conducted 

6. Schedule of activities (See Figure 2) 

7. Plans fordissemination and implementation of the findings 



Developing Competency in Program Evaluation 

Colleges of education have alloted limited time in the prepara- 
tion of administrators and teachers for the modern day role in 
evaluation. With the advent of specific behavioral objective 
evaluation techniques, computer memory storage and data analy- 
sis, most administrators and faculty members find themselves in 
need of updating in program evaluation. The RCU will act as a 
resource of assistance for this training for the local evaluation 
project and will provide materials and training workshops to help 
the local professional staff to become prepared for the task. 




Figure 2 

Proposed Plan for Local Evaluation 
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CHAPTER III 

MAJOR ACTIVITIES AND THE SYSTEMATIC APPROACH 



Studying the Existing Program 

Following the evaluation plan developing process, a detailed 
study of the school's current programs for vocational education 
should be the next undertaking for the project. The numbers of 
the faculty committee should assemble and compile all informa- 
tion regarding the course offerings, enrollment, related general 
courses, and the vocational guidance program. The total faculty 
should be involved in this step to a lesser degree. Total infor- 
mation compiled should be reproduced and disseminated to all 
faculty and to each member of the consulting and advisory com- 
mittee group. Chapter IV of this manual describes in detail the 
organizing and using of the major resources for evaluation. 



Stating Philosophy and Objectives 

Evaluation properly should include the writing out of specific 
objectives and the gathering of evidences of the extent of attain- 
ment of the objectives. All staff members should assist in 
thinking through and writing statements of philosophy and gen- 
eral objectives of the school program as they pertain to the 
preparation of youth and adults for entrance into the world of 
work. Models of these general objectives may be seen in the 
Appendix A of this manual. Vocational programs process evalu- 
ation is based upon the delienation and evaluation of these major 
objectives. 

Formulating Evaluation Criteria 

A criteria question or statement is one which places the pro- 
gram objectives or a portion of one objective in such a way that 
an answer is called for that attempts measurement of the degree 
of conformity in behavioral terms. The task is to identify these 
questions or statements and have them worded in such a manner 
that they may be answered with a degree of behavioral action 
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or reaction, 
procedures: 



For example, in the evaluation of administration 



.-..^uu.dBes me teacher to use new ideas. The degree of 
measurement of this criteria should be always , often, occasion- 
selta or not applicable . In formulating these criteria it is 
we ,0 Identify the^3^sources and means of obtal^ng or 
mg t e necessary data. This data may relate to teachers 
ormer students, community manpower needs, or others. 

The Local Evaluation Project, through extensive research and 
developm^t, has organized eight evaluation instruments. Three 
these behavioral objective type instruments have been admin- 

and^ Mp local school systems, (Polk and Robertson County 

and Memphis Area School). Critique of these three (Public RelZ 
tions. Facilities and Learning Activities, See Appendix BCD) 
as considerably sharpened the behavioral criteria. Through' the 
use of these instruments with ten select school systems the 
project anticipates more improvement this year. Your personal 
assistance in improvement of the instruments is ear^stli solic! 



Analyzing, Interpreting and Reporting Information 



niirt r fif ‘^''Itoria items and com- 

alysia and compilation, these data may be judged by the eval- 

h rjr "f Further study f 

hese data and consultation by the state department personnel 

aram!'^ P™''ide lustification for improvements in present pro- 
grams, or for the initiation of new programs. For those areas 

SrshL d'^h evaluation new criteria questions of inadequate 

Fomiulating and Implementing Recommendations 

n IS expected that recommendations for improvements in 
xis iiig programs should be made by representatives of the 
o(a acu ly, administration and the advisory committee. Imple- 
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meriting recommendations is recognized as primarily the local 
responsibility. The details ot formulating and implementing 
recommendations are described in Chapter V! of this manual. 

The local evaluation project is designed with the main empha- 
sis on continuing evaluation. It is anticipated that this contin- 
uing emphasis should call for a renewal ofthe evaluation process 
on a periodic basis to discern whether or not recommendations 
or changes should be implemented. It should be recognized that 
certain recommended changes made in an existing program could 
detract from the Quality of that program and unless evaluated 
within an appropriate time might be the cause of complete failure 
of that program. 



CHAPTER IV 



ORGANIZING AND USING MAJOR RESOURCES FOR EVALUATION 



Several important resources for the local evaluation project 
include the faculty of the school, the students of the school, 
citizens of the community, the facilities and services of the 
school and resource persons from the State Division of Voca- 
tional Technical Education and RCU. The effective local evalua- 
tion loader identifies these sources early and plans for their 
utilization. 

The Role of the Local Leader 

As soon as administrative arrangements are made, a local 
leader and an "evaluation team" or faculty steering committee 
for evaluation should be appointed by the chief administrator. 
This should not be a large committee but should include key 
persons in the school. Each specialized vocational area should 
be represented. Other areas which should be represented include 
guidance, administration, and genera! education curriculum. 

The local leader of the evaluation effort serves as chairman of 
this "evaluation team" or steering committee. He also serves 
as spokesman for the team in communications to administration 
and to the public. In a large or multi-school local system, it is 
advisable to appoint a research associate for each school or 
division. The leader and his research associates make contracts 
with other faculty members, advisory committee members, employ- 
ers, employees and resource persons. 

A member of the evaluation team calls the necessary staff 
committee meetings, chairs them and democratically guides the 
work of the individual committees. The local leader and his 
associates prepare or cause to have prepared by other staff mem- 
bers relevant data and other materials for the compilation of the 
evaluation report. In short, the role of the "evaluation team" or 
steering committee encompasses all the steps identified in the 
evaluation project including the critique of the final report as 
prepared. 

f 
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In the multi-state experimental local evaluation project (1969- 
70) it was found that record keeping by local leaders helps to 
clarify their roles for themselves and others. Such records have 
included logs of their own activities, minutes of meetings and 
competencies and copies of materials produced including data 
gathering instruments, correspondence and similar materials. 
These records are of value in helping the local leaders to evaluate 
their own activities and to make future evaluation more efficient. 

Faculty Involvement 

Before a faculty steering committee can become effective, it 
must be oriented to the task and understand the meaning of pro- 
gram evaluation. Few teachers have experienced evaluation 
beyond that which they conduct to appraise the achievement of 
students in connection with the courses they teach. Exceptions 
may be the participation in an outside evaluation conducted for 
accreditation purposes. Some teachers are apt to feel threatened 
and therefore, need to be assured of the purpose of the project, 
namely to determine the extent to which the total effort of 
personnel, curriculum and activities of the school are achieving 
the goals to which the school, its supporters and its clientele are 
committed. 

There are several alternative ways of providing staff time for 
work on evaluation projects. Some schools, for example, have 
budgeted f:"'ds for in-service education and curriculum planning. 
These co^ki t e used to support staff activities in the evaluation 
project. Some members of the school staff are enrolled at a 
university for graduate study. Independent study or research for 
graduate credit is another way to encourage staff work on evalua- 
tion. A comprehensive local evaluation project provides a 
variety of in-service training experiences and program improve- 
ments for the vocational program. 

It is important to the overall evaluation project to have 
optimum participation by all members of the faculty of a school. 
This means those assigned at all levels and foi- all curriculum 
areas. Faculty meetings are useful to help emphasize that 
every course and student activity and every faculty member may 
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make a significant contribution to the career preparation program. 
The need for development of vocationally oriented courses 
potentially beneficial to all students looking forward to employ- 
ment is a typical concern to be explored through such faculty 
means. 

Citizen Involvement of Program Evaluation Through Advisory 
Committees 

The reasons for involving citizens should be well understood. 
The first of these is that those persons affected by the program 
should have a part in the evaluation. That is, those who employ 
the product of the vocational programs should have an opportunity 
to evaluate the program of vocational education. Members of an 

advisory committee thus provide the vehicle for doing so in a 
systematic manner. 

Another reason is that of two way communication. Communica- 
tions from citizens provide information about the interest and 
felt needs of students and employers' needs and opinions. This 
information should be of help in formulating the overall objectives 
of each phase of the vocational program and the purpose and 
practices involved in the evaluation effort. Communications are 
also necessary so that citizens may know what is transpiring 
within their schools. Likewise the school needs to know the 
thinking of the community in regard to its programs. 

The willingness of most citizens to serve on advisory com- 
mittees is an indication of their interest and desire to help the 
school. The school exists for the purpose of serving the people 
of that community, it is then quite natural to keep them well in- 
formed and to place representatives in an advisory role. 

Advisory committees have no administrative or legislative 
authority. This must be made clear. Their role Is advisory only * 
Their recommendations fall into the catagory of suggestions to the 
administration and to the board of education. 

A major factor in the success of advisory committees is a clear 
understanding of the purposes by all concerned. School personnel 
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are more apt to understand the purposes than are the lay citizen 
members of these committees. Administrators and faculty mem- 
bers should take the responsibility for acquainting themselves, 
the board of education, and the members of the advisory committee 
with the purpose of the committee. 

Kinds of Advisory Committees, Roles 



Kinds of vocational advisory committees that have been used 
in different schools are varied, but they may be classified as 
general, department, and craft committees. The general committee 
is usually a representative group of the total community organized 
to give advice on the total school program or of general aspects 
of education in school. Evaluation could be one of several 
functions or interests of such a committee. A departmental 
committee serves a single department or vocational program. 
Industrial education teachers, for example, frequently use the 
term craft committee" for each program such as drafting or 

auto mechanics, etc. The committee function is identical regard- 
less of the term used. 



A general advisory committee is important in any evaluation 
effort whether it is made up or representatives from the depart- 
mental or craft committees or whether its membership isdiscrete. 
In establishing a local evaluation program on a continuing basis* 
It IS even more important to have the general advisory committee 
made up of representatives from departmental or craft committees 
In many instances the individual selected or elected within the 
departmental committee as chairmen may also serve on the school 
general advisory committee. A committee is needed that is will- 
ing and able to consider and give advice on morethan one occupa- 
lional field or program. Thai is, the total contrihution of the 
school system to vocational education should be examined and 
continually up dated. 

A statement of policy concerning advisory committees should 
be developed by the board of education if one does not already 
exist. This policy should be brief and cover only the essential 
pnmts. Typical of these items included in such statements are 
purposes and functions of the committee; number of members; 



method of selecting members; length of members terms; and 
communication procedures. The American Vocational Association 
has published a document including such statements and are 
listed herein. 

Criteria are suggested for membership on an Advisory Com- 
mittee for evaluating the total program of vocational education. 
Employers, employees, parents and former students should be 
considered. 

Interest in the school and its program— which may have been 
demonstrated by assistance on a cooperative occupational 
education program and/or by helping with field trips, etc. 
Willingness to serve, and with time to give to committee 
activities. 

Confidence on the part of citizens in the person's judge- 
ment-which is not always possible to determine in a su- 
burban fringe area, or in a community with a rapidly chang- 
ing population. Ability to communicate information and 
ideas to the community and to the committee. 

Knowledge of employer requirements and needs for em- 
ployees, particularly beginning workers— include persons 
currently working with beginning workers. 

Knowledge of the needs, interests, and aspirations of 
students. 

Purposes of ^ Advisory Committee for the total vocational 
program relating to evaluation can be listed as follows: 

To help identify and describe occupational training needs; 

To assist in the formulation of objectives of the school's 
program of occupational education; 

To provide advice regarding use of data-gathering instru- 
ments within the community; 

To assist in the interpretation of data regarding outcomes 
of the program; 

To assist, where appropriate, in appraisal of facilities and 
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equipment for vocational education; 

Other purposes, more directly related to program planning 

are: 

To assist school officials in the development of sound and 
adequate policies relating to occupational preparation; 

To interpret programs of vocational education to fellow 
citizens and enlisttheir support in seeking improvements; 

To assist in formulating recommendations for improvement 
of the program for occupational preparation. 

Departmental and/or craft committees are concerned primarily 
with specific areas of vocational education such as agriculture, 
auto mechanics, secretarial, etc. The purposes of the advisory 
committee for a specialized vocational area include: 

To assist with the development of departmental policies 
within the framework of school policy for occupational 
preparation; 

To assist the general committee in identifying opportunities 
within a field of specialization suchas business occupa- 
tions; 

To assist in the formulation of departmental objectives 
within the framework of the school's total vocational 
program objectives; 

To interpret the deptvtmental program to the community and 
the General Advisory Committee and enlist support in 
seeking improvements; 

To provide advice on the use of data-gathering devices for 
the specialized area, 

To assist in interpretation of data regarding outcomes of 
the department; 

To assist in the appraisal of departmental facilities and 
equipment; 

To assist in formulating recommendations to improve the 
department. 

The size of the committee is an important consideration. This 
will vary by size of the community, the scope of the vocational 
education offerings, the diversity of businesses and industries in 
the community, and the purposes of the committee. The committee 
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should not be so large as to be unwieldly or so small as to be 
unrepresentative of the community. Ten to fourteen committee 
members have proved to be a desirable number for general com- 
mittees. Departmental and craft committees have been smaller, 
with five to nine members suggested. 

Names of persons to be considered for nomination to the 
advisory committee are best suggested by members of the school 
faculty and administration staff with the final approval made by 
the board of education. Suggestions are commonly obtained by 
faculty members from citizens in the community who are casually 
and informally asked if they would care to servej£called to an 
appointment on an advisory committee. Persons suggested shciuld 
not be nominated by organizations or agencies, although the head 
of an organization may be asked to suggest someone for the 
committee. The key point is that each member on the advisory 
committee should regard himself as representing citizens not. any 
organization or business. 

The faculty steering committee, under the direction of the local 
evaluation leader, should present a list of nominees to the ad- 
ministrator. Names of prospective members may be further 
screened by local administrators through informal or unofficial 
inquiry to ascertain willingness to serve. Ideally the nomina- 
tions when submitted to the board of education should include 
more names than needed for the particular committee. The board 
has the final responsibility of approving, or not approving, 
individual nominations. Persons selected by the board should 
receive official notification of this selection, preferably by letter 
from the chief administrator. Personal contact by the school 
faculty representative following the receipt of letter of appoint- 
ment will help to start the committee on a positive note. 

Committee members should be appointed for a definite length 
of time (two or three year terms are suggested). Terms should be 
staggered and replacement selected by the same process as the 
original committee. It is also recommended that no member should 
be allowed to succeed himself. Committee membership would 
thus change over a period of time to provide broader representa- 
tion of the overall community. 
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Each team member; ie. teacher, student, advisory citizen, and 
professionals charged to mark his best value judgment for each 
item on each form. Discussion of each individual objective is 
encouraged as a continuing part of the evaluative process. The 
time required to provide the familiarization program and to per- 
form the team evaluation using the three basic instruments 
(Public Relations, Facilities, Learning Activites). The total time 
involvement to complete the schools evaluation should be recog- 
nized as substantial. 

A typical schedule for the Local Evaluation Project participa- 
tion by a local school system is shown as figure 3. 



Figure 3 

LOCAL EVALUATION PROJECT 
Typical Schedule 



Dates 


Function 


Oct. 11 


Preliminary orientation meeting with administration 


Oct. 14 


Local Organizational meeting of Faculty Steering 
Committee 


Oct. 21 


Local Advisory Committee Meetings 


Oct. 25 


Local Selection or Advisory Committee Team 
Members; Local Selection of Student Team Members 


Oct. 28 


Training Session of Faculty and/or Evaluation Tean; 


Oct. 29 


Team Evaluation of (1) Public Relations, (2) Learn- 
ing Activities, and (3) Facilities 


Nov. 29 


Local Adoption of Departmental and School Philo- 
sophy Select Target Student Class Sample 


Dec. lb 


Local Student Team compiled former student addresses 


J an. b 


Review student Follow-Up Materials 


Jan. 7 


Mail Out #1 Student Follow-Up ''Cards" 


Jan. 14 


Mail Out tt2 "Survey, Envelope, Letter" Local Team 
Select "Employee Appraisal" interviews 


Jan. 25 


Mail Out #3 " Cards" 


Jan. 27 


Local Advisory Committee Meetings 



Feb. 8 


Mail Out #4 ^'Survey, Envelope, Letter" 
Local Evaluation of Oct. 29 


Review 


April 27 


Local Advisory Committee Meetings 






Local Completionof'^ Employee Appraisal" interviews 


April 27 


Formulate Recommendations 




May 29 


Present Recommendations to Evaluation 
Advisory Committees and Administration 


Team, 



CHAPTER V 



PRODUCT EVALUATION - STUDENT FOLLOW-UP 
and EMPLOYEE APPRAISAL 



Product-Process Evaluation Relationship 

The primary function of Vocationai-Technicai education is to 
provide quality employees to business and industry. In business 
and industry, the process quality is largely a responsibility of 
the personnel employed (the product of Vocational-Technical 
education). It is generally recognized that in business, manu- 
facturing or services the product relates closely to the quality 
of the process. Upon this idea the Local Evaluation Project 
attempts to relate the process of education to quality of its 
product (the student). See Figure 4. 

An assumption is made that the Student Follow-Up(See Appen- 
dix E) information and opinion and that obtained through inter- 
view with the former students immediate supervisor (Employee 
Appraisal, see Appendix F) will indeed relate to the quality of 
the vocational-technical program. That such information compiled 
on a sizeable sample will help change and improve the program 
i s doubtless true. 

The focus of this project is Local, that is the Local Education 
Agency holds the keys of authority to implement and design the 
evaluation program. Care should be exercised, however, to 
consider the requirements of data collection and compilation at 
the State and even National level in addition to the local needs. 
The Local Evaluation Project portends to compile the data in such 
a manner so as to be useful to the implementing new programs 
and changing or improving existing programs, yet relate to the 
State Division and the Advisory Council requirements including 
it annual report to the U. S. Commissioner of Education. 
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Purposes of the Student Follow-Up 



The purpose ofthe Student Follow-Up is to retrieve information 
about the quality of the vocational program to provide a medium 
to improve that program. Stated another way the purpose is to 
ascertain the degree of attainment of the program objectives and 
provide product quality information to State or National authority. 

Some typical purposes of a Student Follow-Up investigated by 
other evaluation projects are as follows:* 

To obtain information and value judgments about work prepa- 
ration for a specific job through the schools program. 

To determine the mobility of the former students. 

To determine the adequacy of preparation for continuing edu- 
cation. 

To identify the kinds of vocational experiences desirable for 
future training toward specific occupations. 

To ascertain the former students frank opinion of the school 
and each career program. 

Student Follow-up and Employee Appraisal interview instru- 
ments have been designed to meet these purposes for the Local 
Evaluation Project and to provide the necessary data for State 
and national requirements. These designs were based upon simi- 
lar instruments presently in use in Tennessee and other states, 
the local education agency, however, may modify these in terms 
of the local requirements. 

Students To Be Sampled 

The classes of former students to be studied in a student fol- 
low-up should be out of school sufficiently long to be settled in 
employment. Graduates and dropouts alike should be sampled to 
avoid misleading data. Some schools select one class that have 
been out at least one year and follow up that class for a long 



*Multi-State Project on Local Evaluation, Michigan State 
University. 
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period (20 years). Other schools select classes out one, three 
and five years to follow i:p one time. Where large numbers of 
students are available, random or selective sampling is recom- 
mended. 

In the case where the entire school output process is being 
evaluated, both those former students enrolled in vocational 
courses and those not enrolled must be surveyed. Comparisons 
of the two groups is one type of analysis of the school curriculum 
relative to career preparation. 

The classes of former students to be studied should be chosen 
early and the assistance of a present student committee should 
be solicited to address letters, envelopes and actually seek out 
current addresses of former students. Previous studies have 
indicated the strengthening effect of the student contact to the 
follow-up procedure. 

A general outline of the recommended mailing procedure is as 
follows: 

Suggested Procedure* 

1. Select the target class or classes (out 1 year minimum). 

2. Appoint or select Student Committee. 

3. Student Committee complete current mail list 

4. Address 1st mailout: Cards-request forwarding! 

5. Revise addresses of students whose cards are returned to 
school. 

6. Address 2nd mailout: Cover letter, return stamped enve- 
lope, Survey, care with student names on letter and enve- 
lopes. 

(Week two) 

7. Check student responses with care on mailout list. 

8. Address 3rd mailout: Cards, to students not responded! 

(Week four) 

9. Check student responses on mailout list. 

10. Address 4th mailout: 2nd Cover letter, return envelope, 

survey to students not responded! 

(Week si x) 

^Adapted from original material developed by Kentucky, VEEP. 
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Example: 


Do 


Do 


Don' 


t 


1st Mailout, Friday 


Oct. 8 


J an. 7 


Dec. 


10 


2nd Mailout, Friday 


Oct. 15 


Jan. 14 


Dec. 


17 


3rd Maiiout, Tuesday 


Oct. 26 


j an. 25 


Dec. 


27 


4th Mailout, Tuesday 


Nov. 9 


Feb. 8 


j an. 


10 



Every effort should be made to provide a high return rate in 
the student follow-up survey. Techniques have been developed 
that produce high return rate at the most economical cost to the 
school. These techniques included: involvement of the present 
students, mailing a "get prepared" card, a brief yet personal 
committment cover letter,a well designed instrument that requires 
a minimum of time and effort to answer, follow-up by a reminder 
card then finally send another survey and a personal type letter 
to non-returns. Each ofthese techniques is described separately. 

Involvement of present students in previous- studies has pro- 
vided addresses and language barrier breakdown that provided a 
higher rate of former student survey return. A more personal 
feeling is established in the survey as the present students are 
involved. One of the most important factors of a successful 
survey is to avoid holiday mailing. The technique of mailing a 
card to the former student prior to mailing the survey has an 
important function, that of alerting the former student that he will 
be receiving an important survey and that his participation is 
vital to the success of the school which he represents. Econom- 
ically the 6C card replaces an 8C letter plus 8C/stamped return 
which may no[ reach the former student because of inadequate 
address. 

The card and the survey-cover letter should be mailed out so 
as to be received about the same day (Monday) of the week. 
Whereas the third and fourth mailing is posted so as to be 
received at a later day (Friday). This technique has been de- 
signed since some people are early-in-the-week performers and 
others late-in-the-week performers. 

Cover letters should have the school letterhead, should be 
brief and as personal as possible, should explain the data uses 
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in school curriculum planning, should be signed by a present 
student, a vocational teacher in the former student's vocational 
program and preferably signed by the school administrator or 
guidance counselor whom the former student will recognize. 
The cover letter and survey instrument should f^-ive a clean, 
neat, and professional appearance. Large numbers of survey 
instruments should be pre-planned for electronic data processing 
to minimize the cost. 

Inevitably some of the cards and survey instruments will be 
returned marked "address unknown." It is important to have 
accurate and indexing of former student addresses during the 
actual survey period. Previous studies have indicated that pre- 
sent students provide interested and accurate assistance in this 
endeavor. 

Previous studies have also indicated that survey instruments 
often get mislaid or lost, that a second survey and cover letter 
clearly relating that this just happens will often bring a sizeable 
increase in the number of returns. Sample letters are included 
in the Appendix G. 

Analysis of Student Follow-Up 

The compiling of the former student survey data in the Local 
Evaluation Project, is the responsibility of the RCU. The data 
will be tabulated; graphs and charts suitable for data portrayal 
will be presented to the individual vocational instructors, and 
administration of the schools for program improvement recom- 
mendations. 

Employee Assessment Interview 

In the Local Evaluation Project, the Employer Appraisal instru- 
ment was designed to be used as an instructor aid in the inter- 
view of the former students' immediate supervisor. It includes 
items to determine the former student's on-the-job performance, 
training for the job, work attitudes, etc. in specific behavioral 
statements. 
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Using the Student Follow-Up data, former students names may 
be selected to appropriately sample the business and industry 
representation. Care should be exercised to sample various 
levels as well as the breadth of occupations in eac.i business 
or industry where possible. For example, LPN, RN and Physicians 
Assistant, or machine operator, machinist, tool & die maker, 
each demonstrate a unique level of required training. Selection 
should be made to obtain a representative cross section of the 
total student class. Advisory committees provide valid assist- 
ance in the former student-employee selection process. 

The main reasons for conducting the Employee Appraisal are 
to assess the quality of product trained by the vocational-tech- 
nical program, to secure facts and opinions of the employer- 
su[)ervisor relative to the training program and to secure leads 
to more or better sources of data. Former studies have indicated 
that vocational-technical ins true te-'s gain personal experience 
from conducting the Employee Appraisal interview. The inter- 
view provides an opportunity for the instructor to take a first- 
hand look at the employees actual work environment. 

Interview Procedure* 

An outline of a suggested procedure for conducting the 
Employee Appraisal interview of the vocational instructor is as 
fol low's; 

1. Select former student-employees for interview (assistance 

of advisory committee, cross section representation 
of total studen group and business industry). 

2. Secure as much information as possible about the former 

student. 

3. Estal)lish in advance an appointment with the personnel 

manager or immediate supervisor of student. 

4. Explain briefly the purposes of the school improvement 

evaluation project to the supervisor and ask for his 
(her) frank and accurate help. 

"Adapted from Multi-State Project, Michigan State University, 
1970. 
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Pn'soni tiu' Employee Appraisal form to supervisor, 
uHiiH'st lu' com|)let(' it while you are there to answer 
any qu(\stions. Do noj^ leave form for supervisor to 
com|)lete latio! 

(>. Closi' the interview on time by expressing the school's 
and your appreciation for the help. 

7. Mail a h'fter ot apfrreciation to the supervisor thanking 
him (her) tor the coo|)eration and help. 

B. Taluilati' the Emiiloviu' Appraisal results. 

Analysis of Employee Appraisal 

The compilation and analysis of the data recorded from the 
Lmployiv' Appraisal, m tiu' Local Evaluation Project, is tfie 
responsihilitv ot the KCU. The data will be tal)ulated; graphs 
and charts siiitabU' tor data portrayal will be [)resc'iitc'd to the 
individual vocational instructors and administration of schools 
toi piogiam improveiTUMit rt'comnu'iulations. 
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CHAPTER VI 



PLANNED ACTION - EVALUATION 



Evaluation is visualized as the necessary medium to produce 
change. In the Local Evaluation Project, evaluation is recognized 
as the medium for planned action of program improvement in a 
series of steps. As such, the evaluation program is cyclic and 
continuing, that is, evaluation is repeated as needed to provide 
the appropriate improvement in the school program. By way of 
example, should a school program be classified excellent, there 
appears little need for much more than an annual student follow- 
up to point out minor improvements in the program. On the other 
hand, a program which is assessed slightly above average should 
bring attention to the details needing action to improve the 
quality. Recommendations should be made to the instructor and 
the administration on the basis of the indicated needs. Reevalua- 
tion in this instance is recommended at least annually to assess 
the effectiveness of the planned action toward improvement of 
quality. 

Formulation and Implementation of Recommendations 

Ultimate efficiency in an organization (business, educational 
or industrial) takes place when decisions and impfementingaction 
are made at the lowest ladder level of administration. Changes 
in a vocational-technical education involve different levels of 
decision-making. At the highest level in public education are 
the citizens. The citizens are commonly represented by the 
elected school board who are responsible for financial and 
other major policy decisions. School boards commonly employed 
a trained administrator to implement the major policy decisions 
and depend heavily upon his professional training and experience. 
In recent years a Local Director, Vocational Education, has more 
frequently been employed to assist the chief administrator to 
implement new programs, to coordinate and make major changes 
in existing programs. All of these levels of decision making 
need to be considered. The majority of changes in program con* 
tent, learning activities or public relations, however, are of 
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necessity implemented by the vocational instructor. This change- 
action focus of the Local Evaluation Project was the basic reason 
for the involvement of the local teacher in the evaluation team. 

Recognizing that evaluation should be performed by those 
responsible for change-action, the vocational teacher is the key 
to implementing the bulk of the recommendations. Therefore, an 
attempt should be made to include the particular teacher in 
every conference pertaining to the vocational program for which 
he (she) is responsible. It should be openly recognized, however, 
that a faculty member, working every day with a vocational 
program, may experience difficulty in being entirely objective 
about the evaluation data and the critique of a program. This is 
especially valid for those instructors who for years have thought 
of certain programs as 'Mheir programs." This condition should 
be carefully recognized in the formulating and presenting the 
evaluation recommendations. Evidenceto implement improvements 
in a certain program must therefore be well documented. Use 
should be made of charts, graphs and diagrams to aid in* docu- 
menting the data of the evaluation. Decisions and recommenda- 
tions should be discussed and arrived at mutually agreeable to 
the several levels of administration. A sincere attempt should be 
made to recognize and/or reward the person(s) responsible for the 
improvements in program quality. 

The implementing of program improvements is never an easy 
t^ask. Otherwise many of the improvements might have already 
been made. In organizing and presenting the recommendations it 
IS well to attempt establishing priority criteria. Long-range and 
immediate improvement action should be considered and imple- 
mented on the basis of priority need. Program planning for any 
specific vocational or technical field today is changing rapidly 
because of the accelerated growth in technology which is reported 
to double every five to seven years. 

It is the direct intent of the Local Evaluation Project to develop 
a systematic plan of evaluation which provides an appropriate 
means for making technological improvements in each vocational 
program. Planned-action or improvement in program quality, on a 
continuing basis tan be related directly to evaluation. It is also 
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recognized that research and further development, no doubt, 
should improve the quality of the evaluation-planned action 
program. In as much as the Tennessee plan is being developed 
with local focus, local folks bear the major responsibility for its 
development. May it go on the record that staff members of the 
RCU and Division of Vocational-Technical Education hereby 
seek and request suggestions for such improvement. 
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RESPONSIBILITIES 



A. Responsibilities of the RCU shall include: 

1. Compilation of research information on innovative 
vocational programs, and evaluative instrumenta- 
tion. 

2. Initiation and conduction of conferences and leader- 
ship training workshops to assist in developing 
local competencies in the evaluative program. 

3. Provision of an evaluation manual, guidelines, 
evaluative instruments, related materials and 
limited computer services. 

4. Provision of mini-grants and reimbursement for 
travel for the local evaluation process. 

5. Analysis of data, information and reports from the 
local evaluation. 

6. Preparation and publication reports. 

B. Responsibilities of the Local School shall include: 

1 . To plan, organize and conduct the local evaluation 
in line with the general guidelines furnished by the 
RCU. 

2. Provision of time for the local program director and 
appropriate educator; lay committee participation 
for the conduction of the local evaluation program. 

3. Provision of facilities, clerical services and records 
for the conduction of the local evaluation. 

4. Making of requests for consultant services appro- 
priate to the local needs. 
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Appendix A 

DEPARTMENT OF INDUSTRIAL EDUCATION 
GENERAL OBJECTIVES 
TO DEVELOP IN EACH STUDENT 



An understanding of industry, its materials, methods, 
processes, employment opportunities . . . 

Problem-solving ability related to industry communications, 
transportation, finance, management, facilities, public 
relations and responsibility, marketing . . . 

A responsibility for and appreciation of each job done with 
pride of quality relative to design, construction and crafts- 
manship . . . 

The technical skills required at job entry in one area of 
Industrial Education, his choice . . . 

A comfortable worker-employee relationship . . . 

The need to continue his personal and occupational develop- 
ment. 
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SIDE ! P^LIC ^ElAM'NS E'/ALU'^M'^N 
^ftM£ OF SCH .^L “xTE pt?qr,.?AM DEPT. 

P‘3irp'J I'F E/ALUAf''^ 



:iC^^OL NO. 



Olr^ECriiNS FTP HA-<stNr, The shfet 

■}C\^ EACH 3T/'.rEMENT ThEh JUO^E T-if OECIFF T'> vhICH 
the STATEmEmT is T ?uE P is ACC'''HPl IShED 1Y T 'E 
T? DEPA<»TmEMT, 



USE THE FOLLCwtNG SCALE: 

:f N'^T AOPLICAALE 1LACKFN SPACE UN0E3 

IF /ell “elow average >l'^cken space UNOEM- 

IF SLtr.HTL'^ ‘lELO / AVF-MGE H^CKEN SPACE ‘JNUER- 
IF SLIGHTLY ARnVF AVERAGE ^lACkEN SPACE UNDER- 

IF well agove av£p.\',e tlacken space UNOER 






Jl±LUJJlL31, 
iLllJULLfil 81 




0 I 2 ? 4 

1 

0 12 3^ 

i 

0 12 3^ 

I 

n 1 2 3 4 

I 

0 12 3 4 

• : ■: I 



A Hr V WELL IS THE PR'^GRAM/OrpARTMENT ORGANIZED FOR PUBLIC ?ELATnMS? 

1. The pronram/departnient has an active advisory conmittee- 

2. Thei*e are systematic a. id orcianized procedures of rep . tinR news and 
announcements to news media-----*-------— 

3. The admini strat ion facilitates the public relations effort-- — — 

4. The admini strat ior. assigns specific public relations duties to each teacher— . 

5. The admini strat ion ets feed hack from faculty, students and the 

public before making dec i sions--— 

6 . Overall, how is the program orqani 2 ed for public re la t i ons*- 

B TO vhat extent are ACTiviru: pr ivijeo to facilitate pijAui-: relations? 

1 . Hcetinqs and exhibits arc arranged to inform the . ubl ic--*---.. ------------ -- 

2, Faculty meetings arc scheduled to keep the school atafT informed—-—- 

3» Class and other learning activities oromote public re lat ions-— 

4, Teachers speak to business, industrial and professional nrf'ups— 

5, Teachers participate in community ac t ivi t ies---*--->------------ 

6 , Teachers promote welfare of total school 

2, Individual teacher conferences are held with interested oersons---- — - — — --- 
8. Overall, to what extent are activities of sufficient nun-er and quality—— — 



01234 

0 [234 

0 1 2 3 4 

J ■; -j [j !l 

U I 2 3 4 

I. =1 -I I .1 

01234 
6 I H 

0 I 2 3 4 
0 I 2 3 4 
61234 
6 1 2 3 4 

0 12 3 4 

61234 

0 12 3 4 
0 12 3^ 
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SIDE 2 c'URLIf: ^EL-rinN5 EV-L'J\Tr^N 
REMEMBER! 

NOT applicable blacken SPACE UNDER - 0 
WELL BELOW A7ERA''.F BLACKEN SPACE UNDER - 1 

Slightly belcw average '*lacken space under - 2 
Slightly above average blacke*; space under - 3 
WElL above average slacken space under - u 




C TO ’JMAT EXTENT ARE ^v,S REPORTS GWEN TO ^^ACILITaTE PUBLIC RELAT WnS > (N^ jSPAPE ^ RmOIo, T.y, 

1. Oocumei.tarfes of programs are wrUten and presented— ^ ^ ^ ^ 

2, Advisory cofwiittee activities are reported— 0 12 34 

B. Pfoqram activities are ''cported™— — ^ \ ^ ^ 

4, Human interest stories are reported--- — . — — ^ ^ ^ 

5. St.iff has produced news articles and ^ ^ ^ ^ 

Staff has produced articles for professional journals- 0 12 3 4 

7. Overall, to what extent does the program make use of the nCwS 

media in fostering good pu‘>lic relations ^ ^ ^ 

0 TO WHAT EXTENT HAVE ErFQRTS lEEM EFFECTIVE? 

1. Tho public attends vocational deoartment activities -md meetings ^ * 2 34 

2. Local business and industry make available materials and personnel- ^ ^ ^ 

^ 5. Advisory conmittee exhibits interest and leadership in public relations ^ M 

? The administration uses counsel and advice of advisory coctrittee- — ° ^ 

J 5. News articles are posi t ive-.-- ------ - 0 12 3^ 

i_ ” ----------- 

2 6. School oersonnci understand qools and objectives of the prcqrtm-.. ... ^ - r 

7. Co-Operation is shown an-onq students, teachers, administrators and public 0 I 2 3 h 

8. Favorable ittitudes arc demonstrated -y faculty members Inward 0 I 2 J i. 

9. business and industry voluntarily conynuni cate their needs to the administration 

I I and i ns true tor- 1 2 3 4 
y 

- 10, Builness and industry seek employees from the program- — ... ^ ^ ^ 

II. Overall, h^w effective is the total public relations program 9 ^ ^ ^ 
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Appendix C 
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;r r-.r .^,1 r .P-, jt.v.f rK “it ',-r f r- ./.fj mr ;rnT£Hrf.r 

.y :.;t cz- '■.--.m ,..v > USE the S^i-LF • 

0 » z 3 4 

-I 

01234 

u I 2 3 

I 

1234 

I 

C l 2 3 4 

1 



0 r '2 3 4 
c 1 2 3 4 

0 I 4 ^ 3 4 

01234 

0 12 14 



1. Fac'litics are larnc enou';H in size to accoftimorid tc Ihr .tuflont I oad- - 

2. The trachf-r ha. a private o» f ice for student toimstHng- 

1 • The depiir*'nent is lociited 1 '^nvnn i t ni I y in : hi* sc hoo I 

4. Pocilities are shaped and r;t-:.i mrd suitably for Icarninq ac t ivi t ics— 

5. The flcoartrncnt f.iC’litie. provide a separate cl.i ssroow— 

6. The department facilitits have suitable floor conditions 0 12 3 4 

7* rrMin.i '*eiiht is vderua le — __ 0 12 3** 

6, The department liphiin i is aderuptc — - _ '12 34 

9* The department heatinq is adequate-— — .. 0 12 3 4 

10. The department ventilalinq and tooMnq is adequate 1 2 3 4 

11. The departTent facilities have noise reduction C'jndi t i cjos-.*. 01234 

12. Toi lei facilities »ire avai lahle near the department--- — 01234 

13 . Dept, facilities have appropriate kinds of fire ext inqui sher s available—-..—. ^ ^ ^ 

14. The department cviuipnent »'js eleclrical voltaqe marked (e.q. IlD jt.'.) J 1 2 3 4 

1*5. ra. ihties Have suUuhIr nutsidc door for materia; and orpject loading ^ 1 ^ 3 *t 
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OIOF 2 ,/^CATI.^nAl rACtL*:iE$ EVALUATION 
'-:“EM‘^EH: 

I- fi--T APPlTLm 'LE »^LArKEN \ MCE U 'OFR - 0 
If Vfu LOW nL\c^(.H SP^CE UN0£^ - I 

K ^Ll''iHrLV ^ELf W .\jl ?A .r -’LACkEN SPACE UNOE^ - 2 
IP SlIP.'ITlv AA.*„E ■w:^a.e -LvCrE^i SPACE UNOE'? - 3 
ir well ARVyE AcE-tA'.t SP'CE UNDER - 4 

K* ^hcrc arc cnouqh storage areas for Icarninr^ material s- 
l/« Fnoun^ stora'ic soacc is provided for student projects- 
Id, The Heoortrticrit facilities have adeauate sizeo storaqc areas------ 

19 , fhe ("i'oar tment lacilitics ^ave conveniently located storafje areas—--------. 

20, A notion oicture nrojettor is utilized in inst rue t i on-----. 

21, A slide film str ip orojec tor is utilized in i n st rue t ton-- — 

22, An overhead transParenc/ ornjectnr is utilized in i n st ruc t ion----------- 

23* An audio or cassett recorder is utilized it i nstruct inn..— 

2A, A vider> co'^era and recorder is utilized in ins t rue t i on--- - - 

25, There is a departmental Iihr,.ry of bound books — ---------------------------- 

26 , There is a depa r titiento I li' rary o^ maqaz i nes--- — 

27* Adequate departmenta 1 libr.jry funds arc provided each year- 

28 , There is an aOrquole chalk hoard ut i I i zed------ 

29* There is a bulletin board ut 1 1 i zed-----»-- 

30 , New shop or lahoratnry '-ruioment is budqcLed each year------.--—----. 

31* All shop and laboratory ecuioment arc ecuippcd with safety features----. 

32 , The depart'^rnt e'Tuinmp''' is arrannrd tn factlitalr I earn i n q oc t i vi t ies- 

31, art* suf‘^cirpt worv stations for the <;tuder! ... 

3ti, The dco-irt-nent fa'^ilitics have up-to-date ccuiprx'nt- - 

39« Equipnent is I*i< ated a*cordinq tn clinical or vocotional orocess nerds------ 

'.uantitios of instruments and tools to develop students occupational skills 

are sufficient — 

3/« Occupational instruments and tot-Is arc well maintdinnd- - 

3^« Cccupotionol instruments »ind tools are accessible to students - 

3i# There are rnouqh work tables (desks) ---- 

40, zor- *a^lrs (rinsiis) a^e the p''«»uer size for the pro , ram---.----*--- 
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A plan:;:!;g evaljatig:! ; a:^f. *PE'*»rT" pla-: - p*^awn ';p r.'J 

.■.inccrTom r*04 .:c?.'PUc:Ti:iG the ki -a^ ' 

1. The overall goals pro wrli'.er tj*- — 



2. The oojectlves are s^.a^ed in observable or *neas;ireabl«? stuJrr.t beh.ivi.'r- - H ' ~ '1 '■ 

: i 

5. The objectives are ba.'*cd on the needs of t^ic learner-* — || , |] j [] 

h . 

■*. The objectives are designed to meet documented etrplover needs 0 I' 3 ll 

5 . Organised written plans of leariilng activities of the vocational prograr. .* \ 

are maintained h* each teacher - j |] I’j I] |j 

6. The learning activities are based m an adequate analysis of the occupation 0 1 »’ 

g for which the program Is designed [J d ,J [j |] 

7. The vocational-technical prograr Incl ities planning and continuous evaluation ' l '4 

g with school and community reprrsentat Ives (advisor; committee' — ........... G D U 0 0 



S 8. Business and Industry are consulted In planning-.- — — - — . 0^0 

§ 

9- Students help plan class activities. — ........ G li Q 



& 0 : ^ - 

^ 10. A program outline Is planned for eacn student at the beginnings |] [} !] [] [] 

B r i 1- ' 

11 . The planned learning experiences are at several levels of difficulty - OOOflO 

^ ^ i f * : 

^ 12. Plans are modified to meet changing needs and priorities G j G G 0 

E 13. The plans for activities are for both class Instruction and for C I 2 '■ 

t-* supervised shop or laboratory experiences- - [| [] [j H 

la. wiiat is your overall estimate of the degree to ul;lch the planning pr.ase 0 ; 

alves specific directions for conduc;lng the program'’ l -i P d 



B PROCE32 EVALUATION; TO WHAT EXTENT DO ON-COINC ACTlVlTIEG GORBE^pOHr; 
AND/OR CONTRIBUTE TO THE PRXRA.M OB.’ECTIVES'* 



1. Learning activities are meeting individual students' vocational needs - 0 G !) 0 D 

0 1 - 

2. Learning activities are meeting individual students' social and psv ecological needs u 0 G 0 0 

0 l y 5 '♦ 

3. Learning aetlvitiep are provided at several levels of difficulty G J 0 D 3 

0.2 ' ■ 

u. studenta participate in extra curricular activitieo*- - 0 »I 3 B C 

0 12 ' * 

5 . Instructional activities are relaced to students' work experiences whenever possible - u !l 00 

I / * ■ 

6. Opjwrtunlties are provided fer students to assume insiossed responsibilities D 1 ) Q B 

7* Vocational -ilub snd organlsaticnal activitaes are used so exrenstor.s 0 1 2 / « 

of learning activities i. : ; 0 0 

012 ; 

8. Students have the opportunity to take courses required for college e'-trarce- 0 - U 0 0 

'-/er 
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Appendix £ 



School No, 

Naae 

(Married) 



STimBJTT FOLLOW-t/p 



- Department or progr^Ja 
(Malden) (FlrstT 



Employer Name 



Social Security Mo. 



Employer Address 



I, Are you married** Yes hq 

?• Are you currently em-olled In school 
full-time** Yes No 

5. Vhat courses do you feel should be In the 
school curriculum which would be of 
benefit to you In your present Job** 



8. Are you self-employed** ves No 

9. Are you employed in the occupation for 

Which you were trained** Yes No 

10. Were you able to obtain full-time 
employment as soon as you expected** 

^Ves No 



In which area are you interested In ob- 
taining more ocoupatlonal training** 

_ - Agricultural occupations 

Distributive occupations 

_ ^H ealth occupations 

^Hone Bconoalcs occupations 

Office/Businass 

^TbchnlcalAechnlcian 

^^*rrade/Indua tru I 

Other: specify 

5« If you have moved from the co*nunity 
where you want to school, how long 
after you left aohool did you move** 

Have not moved 
within one month 
to aU aontha 

Sevan to twelve aontha 

- — than “waive aonthe 

S, If you left the oOMunlty where you 
attended achool why did you aovet 
^JPo take a job 

— T o atak a job 
Parents moved 

^Oot married 

___^Mllitery service 

— Q o to school 

other: speolfy 

7. What type tohools have you attended 
tlnot leaving thla aohool* 

None 

— ^Community,- or junior oollege 

^Jlllitary aervioaa 
.^Pour-year oollege or unlvaralty 

— Trade op fiuelneaa aohool (Publlo, Private) 
.^^^Correapondanoa Courata 
,^^Arta vooatlonel aohool 
^^Coapany oourat or aohool 
Adult clBaaea 
..^^prentlotahlp program 

Taohnloal Institute 

O ther; Specify 



ll- Did you look for employment In the 

occupation for which you were trained* 
__Ves, found job in *ny fielC 
— y^s. and still looking 
Po« did not try 

No, did not have sufficient training 

12. How long did it take to obtain your 
first full-time emp*'^ymant* 

.^^aefore completing prog ua 

^Leas than one month 

O ne to a lx months 
^SlJt months or more 
Ho full-time Job 

13. If It took longer than you axpeotad to 
find a full-time , plaaaa Indiosta 
the most Important rc -nn. 

^NO Jobs available Jn th r.oMunlty 

_^Wasn*t Intareatad In the joba available 
^^Peranta wanted me to stay at home 
__Laoked skills or other quallfioations 
^Jfaa too young Oot aarriad 
_Purthar training 

W. How many full.tima joba have you had 
alnoe leaving aohool* 

None 

li. If you lift your ,*irit full-time job, 
please indloata tne moat laportant 
reason. 

^Obtained better job 
I»ald off (laok of mork) 

— off (other reason) 

„^^Quit (wanted more money) 

(disliked work oondltlonc) 

— ^ftuit (disliked type of work) 

— < imt (no future in It) 

^Entered military aarvloa 
pother: specify 




55 54 



-T'J DF ST ■'II.L >w - -J r C I fPJE r 



l6. In t:iklng youp present Jot, which of 

the following was most laportant to you; 

Earn money to go to school 

^(lOrklng conJltlor.s 

uob security 
Importance of work 

Opportunity for promotion 

-Serving others 

Personal interest 

:’.alary 

other : ,'pecllV .. 



17. How do you feel about changing your Job" 

I would quit this Job If I had anything 
else. 

I would take almost any other Job in which 

I could earn as much as I am earning here 
T his Jot is average, and I would Just as 
soon have it as any other for the sane money 

I am not eager to change Jobs but would 

do so If t could make more monry 

I do not want to change Jots even for money 
because this is a good one. 



To what extend did the school 
to work with your supervisors, 
and subordinates'* 



18. If your Job required duties for 
which you were not trained, list 
three duties you consider important. 



19. What was your starting pay (before 
deductions) in your first Oill- 
tlme Job after leaving schooP 
Under per week 
$ 50 - $75 per week 

$76 - $100 per week 

$101 - $150 per week 

$ 15l and over per week 



prepare you 
CO -workers 



How well did your vocational course prepare 
you for your first Job? 

Please rate your school frankly on the 
listed items: 

Quality vocational instruction 
Quality academic instruction 
Occupational skills development 
Ftiysical condition of shops 
Teacher interest in students 
Student guidance/counseling 
Job placement of graduates 
Reputation in community 
Availability of vocational programs 
Information about Job opportunities 
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Name and address of two people who 
will always know your location: 
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Appendix F 



employee appraisal form 



Name of School 



Date 



Program or Department 



School Number 



1. Employee is emplcyed in occupation for which he was trained in school- Yes 

2. Employee ip employed in occupation related to his training. Yes no 

3. Employee has health problem that Interferes with job performance. y^_ n o 

4. Employee has physical handicap that hinders job performance. Y es No 

5. Employee was given a job promt lion or merit pay raise within the last year. 

6. Employee has had a lost time accident on job. Yes No 

7. Mould you recocmend the school 'a training program to others? Yes v.o 



Please rate the following with your best judgment s 

8. Employee has received adequate tre’.ning for his present job description. . 

9. Employee appears trained for a better position than presently working. . . 

10. anployee demonstrates the knowledge needed to maintain present position. . 

11. anployee demonstrates the work skills needed for present position.. . . . 

12. anployee demonstrates basic communications skills (listens, talks, writes 

as needed for present position.) 

13. anployee performs the basic arithmetic skills needed for present position. 

14. Employee appears to understand the “language of your industry". 

15. anployee speaks the "language of your industry" 

16. anployee is correct when making on-the-job decisions. 

17. Qiployee performs duties for which he was trained in school. 

18. anployee accepts assignments without complaint. 

19. Employee follows %nritten emd verbal instructions well. 

20. Employee performs routine jobs without supervision. 

21. Upon completion of a job» employee seeks another task. . 

22. Emoloyee demonstrates loyalty to employer. 



23. anployee lends assistance to fellow workers* when needed for the good of 
the group. • 



24. anployee participates in uonmmnity activities (Scouts, Y.M.C.A. , Church, etc.) 

25. E>^loyee dresses appropriately for the job. 

26. toplo/ee maintains adequate personal cleanliness. 

27. anployee starting pay (before deductions) at present job; 

U nder $50 per week 

^$50 to $75 

$76 to $100 

$101 to $150 

$151 and over 



5 


^4 




^2 
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Appendix G 
STUDENT FOLLOW-UP 



Sut;gcsted Procedure* 

1. Select the target class or classes (out 1 year minimum). 

2. Appoint or select Student Committee. 

3. Student Committee complete current mail list. 

4. Address 1st mailout; Cards-reqiiest forwarding! 

{Week one) 

5. Revise addresses of students whose cards are returned 
to school. 

6. Address 2nd mailout: Cover letter, return stamped envelope 
Questionnaire, care with student names on letter a:id 
envelopes. 

(Week two) 

7. Check student responses with care on mailout list. 

8. Address 3rd mailout: Cards, to students not responded! 

(Week four) 

9. Check student responses on mailout list. 

10. Address 4th mailout: 2nd Cover letter, return envelope, 

Questionnaire to students not responded; 

(Week six) 
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Example: 





Do 


Do 


Don't 


1st mailout, Friday 


Oct. 8 


Jan. 7 


Dec. 10 


2nd mailout, Friday 


Oct. ■'5 


Jan. 14 


Dec. 17 


3rd mailout, Tuesday 


Oct. 26 


Jan. 25 


Dec. 27 


4th mailout, Tuesday 


Nov. 9 


Feb. 8 


Jan. 10 



* 



Adapted from original material developed by Kentucky, VEEP. 



AVOID HOLIDAY 



Sample 1st Card 



Mai lout 1 



Date 1971 



As a former student of School your 

fair and accurate evaluation i s needed. In a few days 
you will receive an important survey that can help us. 
Your help and concern is certainly appreciated. 

Sincerely, 

(Signed by) 

Vocational Teacher 
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Maiiout 2 



SAMPLE COVER LETTER 
School Letterhead 



Date 1971 



Dear ( type firff name ) 

Your help is needed! Yes, since you are a member of the class 

0^ 19 vocational program, we need 

your help for a few minutes to answer some important questions. 

In order for us to make improvements we need your fair and 
accurate evaluation. We have designed the questions so that 
only a few minutes is required. Please take time to think about 
and answer each question today. A stamped envelope is pro- 
vided for you to mail your evaluation to us. 

Should you have any questions, please telephone us or write 
it on the margin. Thanks for your cooperation and help to your 
school. 

(Signed by) Sincerely, 



Vocational Student Vocational Teacher 

(Signed by) 

Superintendent of School(s) 

Enclosure: Stamped envelope 

Survey 

, 63 
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sample 2nd Card 
Mailed only to noiweturns 



Mai lout 3 



Date 1971 



Your help is needed and appreciated in the evaluation 

of the vocational program at School. 

Thanks for taking a few minutes to complete answers 
to the survey and mailing it for return to us. 

Sincerely, 

(Signed by) 

Vocational Teacher 
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Mailout 4 



SAMPLE 2nd COVER LETTER 
School Letterhead 



Date 1971 



Dear ( F irst Name) ; 

As a student in the class of 19 your help is needed for 

a few minutes in answering some very important questions. Since 
we have not yet received your answers, we assume perhaps the 
first survey is mislaid or lost. 

We hope to have all class members to help us make some 
important decisions and we want your fair and accurate evalua- 
tion. Please use the enclosed stamped envelope to return the 
completed survey. Thanks for your cooperation. 

Sincerely, 



Vocational Teacher 
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Enclosures 
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